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Abstract 

We provide proofs of the following theorems by considering the entropy of random walks. 

Theorem l.(Alon, Hoory and Linial) Let G be an undirected simple graph with n vertices, girth 
g, minimum degree at least 2 and average degree d. 

r-1 

Odd girth: If g = 2r + 1, then n > 1 + - 1)\ 

1=0 

r-1 

Even girth: If g = 2r, then n > 2^(d - 1)'. 

Theorem 2. (Hoory) Let G = {Vl,Vr, E) be a bipartite graph of girth g — 2r, with ul ~ \Vl\ and 
n_R = \Vr\, minimum degree at least 2 and the left and right average degrees and Then, 

r-1 

riL > ^(dfl-l)^*l(dL-l)L*J, 

i=0 
r-1 

riR > ^(di-l)r*l(dB-l)^*J. 

i=0 

1 Introduction 

The Moore bound (see Theorem 13. ip gives a lower bound on the order of any simple undirected graph, 
based on its minimum degree and girth. Alon, Hoory and Linial [T] showed that the same bound holds with 
the minimum degree replaced by the average degree. Later, Hoory |3] obtained a better bound for simple 
bipartite graphs. We reprove the results of Alon, Hoory and Linial [T] and Hoory |3j using information 
theoretic arguments based on non-returning random walks on the graph. 

The paper has three sections: In Section[2]we introduce the relevant notation and terminology. In Section 
131 we present the information theoretic proof of the result of Alon, Hoory and Linial ^ ; in Section UJ we 
present a similar proof of the result of Hoory [3 for bipartite graphs. 



*This work was done while the author was at the School of Technology and Computer Science, Tata Institute of Fundamental 
Research, Homi Bhabha Road, Mumbai 400005, India. 

^School of Technology and Computer Science, Tata Institute of Fundamental Research, Homi Bhabha Road, Mumbai 400005, 
India. 
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2 Notation 



For an undirected simple graph G — {V,E), let G — (V,i?), be the directed version of G, where for each 
undirected edge of the form {u, v} in E, we place two directed edges in E, one of the form (u, v) and another 
of the form {v,u). Similarly, for an undirected bipartite graph G = {Vl,Vr, E), let G = {Vl, Vr, Elr^Ehl) 
be the directed version of G, where for each undirected edge of the form {u, v} in E, with u G Vl and v S Vr, 
we place one directed edge of the form (u, v) in -El_r, and another of the form {v, u) in Eji^. 

We will consider non-returning walks on G, that is, walks where the edges corresponding to the same 
undirected edge of G do not appear in succession. For a vertex v, let ni{v) denote the number of non- 
returning walks in G starting at v and consisting of i edges. For an edge e, let ni{e) denote the number of 
non-returning walks in G starting with e and consisting of exactly i + 1 edges (including e). 

3 Moore bound for irregular graphs 

In Section [23 we recall the proof of the Moore bound; in Section [321 we review and reprove the theorem of 
Alon, Hoory and Linial [1] assuming the Lemma 13.41 In Section 13.31 we prove this lemma using an entropy 
based argument. 

3.1 Proof of the Moore bound 

The Moore bound provides a lower bound for the order of a graph in terms of its minimum degree and girth. 

Theorem 3.1 (The Moore bound [2 p. 180]). Let G be a simple undirected graph with n vertices, minimum 
degree 5 and girth g. 

r-l 

Odd girth: Ifg^2r+1, then n > 1 + 5^{5 - 1)'. 

1=0 

r-l 

Even girth: If g ^ 2r, then n>2 - !)*• 

i=0 

The key observation in the proof of the Moore bound is the following. If the girth is 2r + 1, then two 
distinct non-returning walks of length at most r starting at a vertex v lead to distinct vertices. Similarly, 
if the girth is 2r, then non-returning walks of length at most r starting with (some directed version of) an 
edge e lead to distinct vertices. We will need this observation again later, so we record it formally. 

Observation 3.2. Let G be an undirected simple graph with n vertices and girth g. 

Odd girth: Let g — 2r -\- \. Then, for all vertices v, n > no{v) + ni{v) + ■ ■ ■ + nr{v). 

Even girth: Let g — 2r. Let e be an edge of G and suppose ei and 6*2 are its directed versions in G. Then, 

r-l 

n > ^[nj(ei) +ni{e2)]. 

i=0 

Proof of Theorem \8.1\ The claim follows immediately from Observation 13.21 bv noting that for such a graph 
G, for all vertices v £V and edges e E E, 

n,{v) > 5{6-lY-^ {iovi>l), no(«) = l; (1) 
n,{e) > {5-\y (fori>0). (2) 

□ 
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3.2 The Alon-Hoory-Linial bound 

Alon, Hoory and Linial showed that the bound in Theorem 13.11 holds for any undirected graph even when 
the minimum degree S is replaced by the average degree d. 

Theorem 3.3 (Alon, Hoory and Linial [T]). Let G he an undirected simple graph with n vertices, girth g, 
minimum degree at least 2 and average degree d. 

r-1 



Odd girth: If g = 2r + 1, then n > 1 + d^{d - 1) 



1=0 



Even girth: If g — 2r, then n >2 — 1)'. 



We will first prove this theorem assuming the following lemma, which is the main technical part of Alon, 
Hoory and Linial |T|. This lemma shows that the bounds ([1]) and ([2|) holds with S replaced by d. In Section 
we will present an information theoretic proof of this lemma. 



Lemma 3.4. Let G he an undirected simple graph with n vertices, girth g, minimum degree at least two and 
average degree d. 

(a) If V £ y{G) is chosen with distribution tt, where 7r(w) — d^/{2\E{G)\) — dy/{dn), then E[ni(u)] > 

d{d- {i > 1). 

(b) If e is a uniformly chosen random edge in E, then E[ni(e)] > (c? — 1)' (z > 0). 

Proof of Theorem ] 3. 3[ First, consider graphs with odd girth. From Observation 13.21 Lemma [3.41 (a) and 
linearity of expectation we obtain 

r-1 

n > E[no(w) + ^ h nr{v)] > 1 + d^{d - 1)\ 

i=0 

where v E V{G) is chosen with distribution tt (defined in Lemma (a)). 

Now, consider graphs with even girth. Let ei be chosen uniformly at random from E and let 6*2 be its 
companion edge (going in the opposite direction). Note that 6*2 is also uniformly distributed in E. Then, 
from Observation 13. 2[ Lemma 13.41 (b) and linearity of expectation we obtain 



n > E 



^K(ei) + ni{e2)] 



.j=o 



i=0 

□ 



3.3 The entropy based proof of Lemma 13.41 

The proof of Lemma 13.41 below is essentially the same as the one originally proposed by Alon, Hoory and 
Linial, but is stated in the language of entropy where some of the arguments based on concavity are explained 
directly in information theoretic terms. 

Proof of Lemma \3.4\ (a) Consider the Markov process v, ei ,6*2, . . . , e^, where w is a random vertex of G 
chosen with distribution tt, ei is a random edge of G leaving v (chosen uniformly from the dy choices), 
and for 1 < j < i, ej+i is a random successor edge for ej chosen uniformly from among the non- 
returning possibilities. (If ej has the form {x,y), then there are dy — 1 possibilities for ej+i.) Let 
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vq — v,vi,V2, ■ ■ ■ ,Vi be the vertices visited by this non-returning walk. We observe that each e*,- is 
distributed uniformly in the set E{G) and each Vj has distribution tt. Then, 

logE[n,(u)] > E[\ogn,{v)] 

> H[eie2 .. .Ci \v] 

= H[ei\v] + ^ H[ej+i \ 6162 • • • ejv] 

i-l 

= E[logd„]+^E[log(d„^ -1)] 
= E[logd„(d, 
an ^-^ 

V 

> logJ(J-l)'-\ 

where to justify the first inequality we use Jensen's inequality for the concave function log, to justify 
the second we use the fact that the entropy of a random variable is at most the log of the size of its 
support, and to justify the last we use Jensen's inequality for the convex fmiction a;loga::(a:; — 
(a; > 2). The claim follows by exponentiating both sides. 

(b) This time we consider the Markov process cq = e, ei, . . . , e^, where e is chosen uniformly at random 
from E, and for < j < i, Sj+i is a random successor edge for ej chosen uniformly from among the 
non-returning possibilities. Let vo,vi,V2, ■ ■ ■ be the vertices visited by this non-returning walk. 

As before observe that each Vj has distribution tt. Then, 

logE[n,(e)] > E[logn,(e)] 

> H[eie2 . . .Cj I eo] 

i 

= 5]E[logK^. -1)] 
i=i 

= E[iog«-ir] 

= -^y^dy iog(rfi, - 1)' 

an 

V 

> log(rf-l)\ 

where we justify the first two inequalities as before, and the last using Jensen's inequality applied to 
the convex function a;log(a; — 1)* (a; > 2). The claim follows by exponentiating both sides. 

□ 



Remark 3.5. Theorem 13.31 holds for any graph with average degree is at least 2. For details, see the proof of 
Theorem 1 in p^. 

4 Moore bound for bipartite graphs 

Following the proof technique of [1], Hoory [3] obtained an improved Moore bound for bipartite graphs. In 
this section, we provide an information theoretic proof of the same. 
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4.1 The Hoory bound 

Theorem 4.1 (Hoory [3 ). Let G = {Vl,Vb, E) be a bipartite graph of girth g — 2r, with nj^ — \Vl\ and 
nji = \Vji\, minimum degree at least 2 and the left and right average degrees dj^ and dji. Then, 

r-1 

TIL > 5^(dfl-l)r^l(di-l)L*J, 

i=0 
r-1 

UR > ^(dL-i)r^i(dfl-i)LiJ. 

i=0 



For bipartite graphs the girth is always even. We have the following then have the following variant of 
Observation [ 



Observation 4.2. Let G = {Vl,Vr, E) be an undirected bipartite graph with \Vl\ — ri^ and |Vr| = ur and 
girth g = 2r. Let e be an edge of G and suppose ei and 6*2 be its directed versions in G, such that ei € E^r 
and 6*2 G Erl- Then, 

> ^ "-2i+i(ei)+ ^ ri2i(e2). 



We will prove the Theorem 14.11 assuming the following lemma, which is the main technical part of 
Hoory ^ . In Section 14.21 we will present the proof of this lemma using the language of entropy. 



Lemma 4.3. Let G ~ {Vl-,Vr, E) be an undirected simple bipartite graph with vertices on the left and 
ur vertices on the right, girth g, minimum degree at least two and average left and right degrees respectively 
dL and dR. 

(a) If e is a uniformly chosen random edge in Elr, then E[n2i+i(e)] > {dR — — 1)* 

(b) If e is a uniformly chosen random edge in Erl, then E[n2i(e)] > (dR — l)*(rfL — 1)* (i ^ !)• 



Proof of Theorem \4-.l\ We will prove the bound for ul- The proof for ur case is similar. Let ei be chosen 
uniformly at random from Elr and let 6*2 be its companion edge (going in the opposite direction). Note that 
6*2 is also uniformly distributed in Erl- Then, from Observation l4.31 Lemma 14.31 and linearity of expectation 
we obtain 



ni > E 



"-21+1(61)+ ^ "24(62) 

1=0 1=0 



r-1 



> ^(dfl-i)r5i(d^_i)LfJ. 



i=0 



□ 



4.2 The entropy based proof of Lemma 14.31 

The proof of Lemma 14.31 below is essentially the same as the one originally proposed by Hoory, but is 
stated in the language of entropy where some of the arguments based on concavity are explained directly in 
information theoretic terms. 

Proof of Lemma \4-.3\ (a) Consider a Markov process eo,ei,e2,--- ,62^+1, where cq is a uniformly chosen 
random edge from Elr, and for < j < 2i + 1, Cj+i is a random successor edge for Cj chosen 
uniformly from among the non- returning possibilities. Let vq,vi,V2, ■ ■ ■ , W2j+2 be the vertices visited 
by this non-returning walk. We observe that for < j < « each e2j and e2j+i is respectively distributed 
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uniformly in the set -Ela and EfiL. Furthermore, for j even, Pr[wj = v] = dy/\E{G)\ for all v € Vl, 
and for j odd, Vv[vj =v]= dy/\E{G)\ for all v e Vr. Then, 

logE[n2i+i(e)] > E[logn2i+i(e)] 

> H[eoei . ..e2i+i \ eo] 

i i 

= ^[e2j+i \e2j] + H[e2j\e2j-i] 

i i 

= J2 E[iog(4.,+. - 1)] + E iE[iog(4., - 1)] 

> (i + 1) logidR + i l0g{dL - 1) 

= logidR -iy+\dL-iy. 

where to justify the first inequality we use Jensen's inequality for the concave function log, to justify 
the second we use the fact that the entropy of a random variable is at most the log of the size of its 
support, and to justify the last wc use Jensen's inequality for the convex function a;log(a; — 1) (a; > 2). 
The claim follows by exponentiating both sides. 

(b) Similarly, 

logE[n2i(e)] > log(di - iy{dR - 1)\ 

□ 
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